TOWARDS A DESIGN SUPPORT TOOL FOR MULTIMODAL INTERFACE DESIGN The Taxonomy Workbench and Theory Demonstrator
نویسندگان
چکیده
This paper presents the layout and functionality of Version 2 of the Taxonomy Workbench and Theory Demonstrator which is being developed at the Centre for Cognitive Science. The Theory Demonstrator uses multimedia/multimodal hypertext to present the taxonomy of unimodal output modalities which has been developed as part of addressing the research agenda of Modality Theory. The Workbench functionality of the system is supported by (i) a facility for classifying multimodal objects represented in the media of graphics, acoustics and haptics; and (ii) a search facility which enables flexible search on the basic properties which define the +70 unimodal modalities generated in the taxonomy. The ultimate objective is to develop the Taxonomy Workbench and Theory Demonstrator into an interface design support tool.
منابع مشابه
A Software Demonstrator of Modality Theory
We began work on the first part of this research agenda, i.e. the development of a taxonomy of output modalities in the media of graphics, acoustics and haptics. A (representational) modality is a way of representing information, e.g. at the human-computer interface. It was realised from early on that work progress might benefit from the support of a software tool in which we could represent la...
متن کاملTHE TAXONOMY WORKBENCH A multimedia database system for analysing representational modalities
Work started by addressing the first part of the research agenda of modality theory, i.e. the development of a taxonomy of output modalities in the media of graphics, sound and touch. A (representational) modality is a way of representing information. It was realised from early on that work might benefit from the support of a software tool in which we could represent large numbers of samples of...
متن کاملTowards A System Of Patterns For The Design Of Multimodal Interfaces
Since R. Bolt’s seminal "Put that there" demonstrator, more and more robust and innovative modalities can be used and empirical work on the usage of multiple modalities is now available for guiding the design of efficient and usable multimodal interfaces. This paper presents a system of patterns for capitalizing and formalizing this design knowledge about multimodal interfaces as patterns. Patt...
متن کاملModality Theory in Support of Multimodal Interface Design
Modality Theory is a comparatively new field of investigation which addresses the following general problem of mapping task domain information into interactive multimodal interfaces: given any particular set of information which needs to be exchanged between user and system during task performance in context, identify the input/ output modalities which constitute an optimal solution to the repr...
متن کاملTHE NITE WORKBENCH. A Tool for Annotation of Natural Interactivity and Multimodal Data
This paper describes ongoing work in the European NITE project on the development of a tool in support of annotation of natural interactive and multimodal data. The paper discusses the resources required for pursuing the vision of natural interactivity and provides an overview of existing natural interactivity data coding tools and projects. After discussing the target user groups of a NITE too...
متن کامل